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Abstract 

In  the  recent  years,  the  multi-level  programming  problems  specially  the  bi- 
level  and  tri-level  programming  problems  (TLPP)  are  interested  by  many 
researchers  and  these  problems,  particularly  TLPP,  are  known  as  an 
appropriate  tool  to  solve  the  real  problems  in  several  areas  of  optimization  such 
as  economic,  traffic,  finance,  management,  transportation,  computer  science 
and  so  on.  Also,  it  has  been  proven  that  the  general  bi-level  and  TLPP  are  NP- 
hard  problems.  The  literature  shows  it  has  been  proposed  a  few  attempts  for 
solving  using  TLPP.  In  this  paper,  we  attempt  to  propose  a  new  function  for 
smoothing  the  tri-level  programming  problem  after  using  Karush-Kuhn-Tucker 
condition,  also  we  develop  two  effective  approaches,  one  based  on  Genetic 
algorithm,  which  it  is  an  approximate  approach,  and  the  other  based  on  the 
hybrid  algorithm  by  combining  the  proposed  method  based  on  penalty  function 
and  the  line  search  algorithm  for  solving  the  linear  TLPP.  In  both  of  these 
approaches,  by  using  the  Karush-Kuhn-Tucker  condition  the  TLPP  is 
converted  to  a  non-smooth  single  problem,  and  then  it  is  smoothed  by  proposed 
functions.  Finally,  the  smoothed  problem  is  solved  using  both  of  the  proposed 
approaches.  The  presented  approaches  achieve  an  efficient  and  feasible 
solution  in  an  appropriate  time  which  has  been  evaluated  by  comparing  to 
references  and  test  problems. 
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Introduction 

It  has  been  proved  that  the  BLP  is  NP-  Hard  problem  even  to  seek  for  the  locally 
optimal  solutions  (Bard,  1991;  Vicente,  et  al.,  1994).  Nonetheless  the  BLPP  is  an 
applicable  problem  and  practical  tool  to  solve  decision  making  problems.  It  is  used  in 
several  areas  such  as  transportation,  finance  and  so  on.  Therefore  finding  the  optimal 
solution  has  a  special  importance  to  researchers.  Several  algorithms  have  been  presented 
for  solving  the  BLP  (Yibing,  et  al.,  2007;  Allende  &  G.  Still,2012;  Mathieu,  et  al.,  1994; 
Wang,  et  al.,  2008;  Wend  &  U.  P.  Wen,  2000;  Bard,  1998,  Facchinei,  et  al.,  1999). 
These  algorithms  are  divided  into  the  following  classes:  Transformation  methods 
(Luce,  et  al.,  2013;  Dempe  &  Zemkoho,  2012),  Fuzzy  methods  (Sakava  et  al.,  1997; 
Sinha  2003;  Pramanik  &  T.K.  Ro  2009;  Arora  &  Gupta  2007;  Masatoshi  &  Takeshi.M 
2012;  Zhongping  &  Guangmin.  2008,  Zheng  et  al.,  2014),  Global  techniques  (Nocedal 
&  Wright,  2005;  Khayyal,  1985;  Mathieu,  et  al.,  1994;  Wang  et  al.,  2008,  Wan,  et  al., 
2014,  Xu,  et  al.,  2014,  Hosseini  and  Nakhai  Kamalabadi,  2014),  Primal-dual  interior 
methods  (Wend  &  Wen,  2000),  Enumeration  methods  (Thoai  et  al.,  2002),  Meta 
heuristic  approaches  (Hejazi  et  al.,  2002;  Wang  et  al.,  2008;  Hu  et  al.,  2010;  Baran  et 
al.,  2010;  Wan  et  al.,  2012;  Yan,  et  al.,  2013;  Kuen-Ming  et  al.,  2007,  Hosseini  and 
Nakhai  Kamalabadi.,  2013,  He,  Li  and  Huang,  20 14). However  several  algorithms  have 
been  proposed  to  BLPP,  a  few  algorithms  have  been  proposed  to  solve  TLPP  (Zhang  et 
al.,  2010). 

The  remainder  of  the  paper  is  structured  as  follows:  in  Section  2,  basic  concepts  of 
the  linear  BLPP  and  TLPP  are  introduced.  We  provide  a  smooth  method  to  BLPP  and 
TLPP  in  Section  3.  The  presented  algorithm  is  proposed  in  Section  4.  Computational 
results  are  presented  for  our  approach  in  Section  5.  Finally,  the  paper  is  finished  in 
Section  6  by  presenting  the  concluding  remarks. 

The  linear  bi-level  and  tri-level  programming  problems 

In  this  section  models  of  bi-level  and  tri-level  programming  problems  are  introduced. 

BLPP  is  used  frequently  by  problems  with  decentralized  planning  structure.  It  is 
defined  as: 

min  F(x;y)  =  aTx  +  bTy 

X 

s.t  min  g(x;y)  =  cTx  +  dTy 

(i) 

Ax  +  By  <  r, 
x,y  >  0. 

where  a,c  £  R"1.  b,d  £  R"2,A  G  RmXni. B  G  RmXn2,r  £  Rm,x  £  Rni,y  £  R"2  and 
F(x,y)  and  g{x,y)  are  the  objective  functions  of  the  leader  and  the  follower, 
respectively. 
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In  general,  BLPP  is  a  non-convex  optimization  problem;  therefore,  there  is  no 
general  algorithm  to  solve  it.  This  problem  can  be  non-convex  even  when  all  functions 
and  constraints  are  bounded  and  continuous.  Of  course,  the  linear  BLPP  is  convex  and 
preserving  this  property  is  very  important.  A  summary  of  important  properties  for 
convex  problem  are  as  follows,  which  F:S  ->  Rn  and  5  is  a  nonempty  convex  set  in  Rn\ 

(1)  The  convex  function  f  is  continuous  on  the  interior  of  5. 

(2)  Every  local  optimal  solution  of  F  over  a  convex  set  X  Q  S  is  the  unique  global 
optimal  solution. 

(3)  If  VF(x)  =  0,  then  x  is  the  unique  global  optimal  solution  of  F  over  5. 

Because  a  tri-level  decision  reflects  the  principle  features  of  multi-level 
programming  problems,  the  algorithms  developed  for  tri-level  decisions  can  be  easily 
extended  to  multi- level  programming  problems  which  the  number  of  levels  is  more  than 
three.  Hence,  just  tri-level  programming  is  studied  in  this  paper. 

In  a  TLPP,  each  decision  entity  at  one  level  has  its  objective  and  its  variables  in  part 
controlled  by  entities  at  other  levels.  To  describe  a  TLPP,  a  basic  model  can  be  written 
as  follows: 

minFjx^z)  =  %x  +  b±y  +  c±z 

X 

Atx  +  Bty  +  C{i  <  rlf 

s.t  minF2(x,y,z)  =  a2x  +  b2y  +  c2z 

y 

A2x  +  B2y  +  C2z<r2,  (2) 
s.t  minF3(x,y,z)  =  a3x  +  b3y  +  c3z 

z 

A3x  +  B3y  +  C3z<r3l 
x,y,z  >  0. 

Where  At  E  RqXk;B;  G  RqXl,Q  G  RqXP;r^  G  Rq;x  G  Rk;y  G  R*,z  G  RP;a^  G  Rk;fy  G 
Rl,Ci  G  Rp ,  i  =  1,2,3,  and  the  variables  x,  y,  z  are  called  the  top-level,  middle-level,  and 
bottom- level  variables  respectively,  F±  ( X,  y ,  z) ,  F2  ( X,  y ,  z) ,  F3  ( X,  y ,  z) ,  the  top-level, 
middle-level,  and  bottom-level  objective  functions,  respectively.  In  this  problem  each 
level  has  individual  control  variables,  but  also  takes  account  of  other  levels'  variables  in 
its  optimization  function. 

To  obtain  an  optimized  solution  to  TLP  problem  based  on  the  solution  concept  of  bi- 
level  programming,  we  first  introduce  some  definitions  and  notation: 

Definition  1 
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S 

=  {(x,y,z)U,x  +  Bty  +  C(i  <  rt  ,x,y,z  >  0. }  (3) 

On  the  other  hand,  if  x  be  fixed,  the  feasible  region  of  the  follower  can  be  explained 

as 

S=  (4) 
{(ylz)|B^y  +  Qz<n-^xlylz>0}. 

Based  on  the  above  assumptions,  the  follower  rational  reaction  set  is 

P(x)  =  {(y,z) 

e  argming(x;y;z);(y;z)  e  S(x)}.  (5) 

Where  the  inducible  region  is  as  follows 
IR=  {(x,y,z)GS,(y,z)  gP(x)}.  (6) 

Finally,  the  tri- level  programming  problem  can  be  written  as 

min  {F(x,y,z)|(x,y,z)  e  IR}.  (7) 

If  there  is  a  finite  solution  for  the  TLP  problem,  we  define  feasibility  and  optimality 
for  the  TLP  problem  as 

S=  {(x,y,Z)|^x  +  B;y  +  qz 

<rit  x,y,z>0}.  (8) 

Definition  2 

Every  point  such  as  ( X,  y;  z)  is  a  feasible  solution  to  tri- level  problem  if  ( X,  y;  Z)  G  I R 
Definition  3 

Every  point  such  as  (x*;y*;Z*)  is  an  optimal  solution  to  the  tri- level  problem  if 
F(x*.y*,z* )  <  F(x,y,z)  (x,y,z)  e  IR.  (9) 
Smooth  method  for  TLPP 

Using  KKT  conditions  for  both  of  last  levels  in  problem  (2),  the  following  problem  is 
constructed: 

minF^x^z)  =  a1x  +  b1y  +  c±z  (10) 
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s.t   A±x  +  B±y  +  Cxz  -  7i  <  0, 
A2x  +  B2y  +  C2z-r2  <0, 
^3X  +  S3y  +  C3z-r3  <0; 
jiUgX  +  Bgy  +  CaZ-rg)  =  0, 
\iB3  =  -b3, 

PU2x  +  fl2y+  C2z-r2)  =  0, 
PC2  =  -c2l 

x,y,z,|i,p  >  0. 

Because  problem  (10)  has  a  complementary  constraint,  it  is  not  convex  and  it  is  not 
differentiable.  In  this  paper  we  propose  a  smooth  method  for  smoothing  complementary 
constraints  in  problem  (10).  Using  the  following  smooth  method,  problem  (10)  will  be 
smoothed,  and  then  we  present  two  algorithms  based  on  Taylor  theorem  and  hybrid 
algorithm  to  solve  it. 

Theorem  3.1: 

Let,  c|>:  R2  ->  R  ,c|)(m,n)  =  2m  -  n  -  V4m2  +  n2  or  c|>:  R3  ->  R  ,  $[m,n,E)  = 

2m  -  n  -  V4m2  +  n2  +  £ ,  where  m  >  0,  n  >  0,  then  c|)(m,n)  =  0  mn  =  0;  and 
cb(m,n,£)  =  0  ^  mn  =  -,m  >  0,n  >  0 

4 

Proof: 

cj)(m,n)  =  0<^>2m  -  n  -  V4m2  +  n2  =  0 

<^>2m  -  n  =  V4m2  +  n2  <^>(2m  -  n)2  =  4m2  +  n2 

<^>4m2  +  n2  -  4mn  =  4m2  +  n2  <=*  -  4mn  =  0^>mn  =  0. 
Also 

c|)(m,n,£)  =  0^2m  -  n  -  V4ra2  +  n2  +  £  =  0 

<^>2m  -  n  =  V4m2  +  n2  +  £<^>(2m  -  n)2  =  4m2  +  n2  +  £ 

„4m2  +    -  4mn  =  4m»  +    +  £«  -  4mn  =  £« mn  =  \,m  a  0,n  S  0. 

4 

Using  the  proposed  function  c|)(m,n,£)  =  2m  —  n  —  Vra2  +  n2  —  £  in 
problem  (10),  we  obtain  the  following  problem: 
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minFjx^z)  =  a±x  +  b±y  +  c±z 

X 

s.t 


A^x  +  5xy  +  Cxz  - 

-  rx  <  0, 

A2x  +  B2y  +  C2z- 

-  r2  <  0, 

A3x  +  B3y  +  C3z- 

-  r3  <  0, 

2|ii-gi(x,y)  - 

|4|i?  +  g2(x,y)  -e 

\iB3  =  -63, 

2(5i-hi(x,y)-J 

4p2  +  h2(x,y)  -e 

pC2  =  -c2, 

xfyfz,m,pi  >  0. 


Which  in  the  first  constraint  m  =  \it  >  0,n  =  —  Qiix,y)  >  0,  gi(x,y)  =  alX  + 
bly  +  clZ  and  al,bl,cl  are  i-th  row  of  A,  B,  C  respectively  and  in  the  second  constraint 
m  =  Pj  >  0,n  =  -h;U,y)  >  0,  hj(x,y)  =  a'x  +  &'y  +  clz  -  r  and  a^b^c1  are  i- 
th  row  of  A,  B,  C. 

Let: 

G(x,y,n)= 

"2^  -  gi(x,y)  -  Vn?  +  g?(x,y)  -  £ 
2^2  -  g2(x,y)  -  Vul  +  gfUy)  -  £ 


2n1-g1(x,y)  -  J Hi2  +  gf(x,y)  -£ 


H(x,y,  p)= 
2pi  -  Mx,y)  -  Vn?  +  h2(x,y)  -  £ 
2p2  -  h2(x,y)  -  Vul  +  h2(x,y)  -£ 

2p1-h1(x,y)-  Jn2  +  h2(x,y)  -£ 


(13) 
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H'[x,y,\i)  =  H[x,y,\i)  --  , 
G'(x,y,\L)  =  G(x,y,$) -\  (14) 

Problem  (11)  can  be  written  as  follows: 
min  Fifoy ,z)  =  a±x  +  b±y  +  c±z 

X 

S.t 

Axx  +  B±y  +  C±z  -  7i  <  0# 

A2x  +  B2y  +  C2z-r2  <0; 

^3X  +  S3y  +  C3z-r3  <0f 

(15) 

G'(t)  =  0, 
H'(t)  =  0, 
I^B  =  -b3, 
PC  =  -c2l 

x;y;z;|i;p  >  0. 
Where  t  =  (xfyf  |i)  E  i?fc+2i 

Because  problem  (10)  equal  to  (15),  we  use  the  following  method  for  solving 
problem  (15). 

Genetic  algorithm  for  TLPP 

In  this  section,  basic  and  general  concepts  related  to  genetic  proposed  algorithm  are 
discussed.  Genetic  algorithms  are  global  methods  that  are  used  for  global  searches.  As 
the  previous  researchers  indicate  (Luce,  Said  &  Raid,  2013),  Masatoshi  &  Takeshi 
(2012)  the  basic  characteristics  of  these  algorithms  consist  of: 

1.  Initial  population  of  solution  is  produced  randomly.  Some  of  the  genetic 
algorithms  use  other  Meta  heuristic  method  to  produce  the  initial  population. 

2.  Genetic  algorithms  use  a  lot  of  feasible  solutions.  Therefore  they  usually  avoid 
local  optimal  solutions. 

3.  Genetic  algorithms  used  to  solve  very  large  problems  with  many  variables. 

4.  These  algorithms  are  simple  and  do  not  need  extra  conditions  such  as  continuity 
and  differentiability  of  objective  functions. 

5.  Genetic  algorithms  usually  gain  several  optimal  solutions  instead  unique  optimal 
solution.  This  property  is  useful  for  multi  objective  function  and  multi-  level 
programming. 
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In  the  proposed  genetic  algorithm,  each  feasible  solution  of  BLPP  usually  is 
transformed  by  string  of  characters  from  the  binary  alphabet  that  is  called  chromosome. 
The  genetic  algorithm  works  as  follows: 

Initial  generation,  that  is  generated  randomly,  is  divided  in  overall  the  feasible 
space  similarly.  Then  chromosomes  are  composed  together  to  construct  new  generation. 
This  process  continues  till  to  get  appropriate  optimal  solution.  The  general  genetic 
algorithm  process  as  follows: 


A  lg  orithm  1  :  GA  to  solve  BLPP 


1:  f  =  0 

2 :  initialize  P(t) 
3 :  evaluate  P(t) 

4  :  While  not  terminate  do 

5  :  F(t)  =  recombine  P(t) 
6:  P"(f)  =  mutate  F(t) 
7:  evaluate  F\t) 

8:  P(f +  1)  =  select  (P"(f)Ufi) 

9:  t=t+l 

10  :  End  of  While 

11:  End. 


Where  P(t)  is  a  population  of  chromosomes  in  t-th  generation  and  Q  is  a  set  of 
chromosomes  in  the  current  generation  which  are  selected. 

In  the  suggested  method,  every  chromosome  is  demonstrated  by  a  string.  This  string 
consists  of 

k  +  I  +  p;  binary  components.  Also  these  chromosomes  are  applied  in  problem  (15) 
that  it  is  created  by  using  Karush  -Kuhn  -Tucker  (KKT)  conditions  and  proposed 
smoothed  method  for  TLPP.  Using  slack  variables,  such  as  w,  v,  u,  problem  (15)  is 
prepared  for  using  genetic  algorithm: 


minFjx^z)  =  a±x  +  b±y  +  c±z 


X 


s.t 


(16) 


i4xx  +  5xy  +  Cxz  -  rx  +  w  =  0 


A2x  +  B2y  +  C2z  -  r2  +  v  =  0, 
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A3x  +  B3y  +  C3z  -  r3  +  u  =  0, 
G'(t)  =  0, 
H'(t)  =  0, 
[iB  =  -b3l 
PC  =  -c2, 

tw  =  0;      vy  =  0,    uz  =  0, 

t,w,v,u,x,y,z,|i,p  >  0. 

Now  the  chromosomes  are  applied  according  the  following  rules  [15]: 

If  the  i-th  component  of  the  chromosome  is  equal  to  zero,  then  tt  =  0;W;  >  0  Else 
tt  >0,wt  =  0. 

If  the  j-th  component  of  the  chromosome  is  equal  to  zero,  then  Vj  =  0;y;-  >  0  Else 
Vj  >  0,yj  =  0. 

If  the  h-th  component  of  the  chromosome  is  equal  to  zero,  then  uh  =  0,zh  >  0  Else 
uh  >  0,zh  =  0. 

Steps  of  our  algorithm 

In  this  section,  the  algorithm  steps  are  proposed. 

Step  1 :  Generating  the  initial  population. 

The  initial  population  includes  solutions  in  the  feasible  region  that  are  called 
achievable  chromosomes.  These  chromosomes  are  generated  by  solving  the  following 
problem: 

min  c3z 

z 

^3x  +  S3y  +  C3Z<r3; 
z>  0. 

Where,  r3  is  a  random  vector  by  changing  it,  the  optimal  solution  changes  too. 
Step  2:  Keeping  the  present  best  chromosome  in  an  array 

The  best  chromosome  is  kept  in  the  array  at  the  each  iteration.  This  process 
continues  till  the  algorithm  is  finished,  then  the  best  chromosome  is  found  in  the  array 
as  the  optimal  solution. 
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Step  3:  Crossover  operation 

Crossover  is  a  major  operation  to  compose  a  new  generation.  In  this  stage  two 
chromosomes  are  selected  randomly  and  they  are  combined  to  generate  a  new 
chromosome.  In  the  new  generation  components  are  created  by  the  following  rules: 

1.  The  i-th  component  of  the  first  child  is  replaced  by  the  sum  of  the  i-th  components 
of  parents  (i=l,2,. .  .,k).  The  operation  sum  is  defined  as  follows: 

0+1=1  0+1=1  0+0=0  1+1=0 

The  other  components  are  remained  the  same  as  the  first  parent. 

2.  The  (k+i)-th  component  of  the  second  child  is  replaced  by  the  sum  of  the  (k+i)-th 
components  of  parents  (i=l,2,. .  .,1+p).  The  operation  sum  is  defined  as  above.  The  other 
components  are  remained  the  same  as  the  second  parent. 

For  example,  by  applying  the  present  method  to  the  following  parents,  and  k=  5, 1=4, 
p=3,  we  generate  the  following  children: 

Parents :  Children: 

10110  1001  101  01100  1001  101 

11010  0111  001  11010  1110  100 

Step  4:  Mutation 

The  main  goal  of  mutation  in  GA  is  to  avoid  trapping  in  local  optimal  solutions.  In 
this  algorithm  each  chosen  gene  of  every  chromosome,  mutates  as  follows: 

If  the  value  of  the  chosen  gene  be  0,  it  will  be  changed  to  1  and  if  the  value  of  the 
chosen  gene  be  1,  it  will  be  changed  to  0. 

Step  5:  Selection 

The  chromosomes  of  the  current  population  are  arranged  in  descending  order  of 
fitness  values.  Then  we  select  a  new  population  similar  to  the  size  of  the  first 
generation.  If  the  number  of  the  generations  is  sufficient  we  go  to  the  next  step, 
otherwise  the  algorithm  is  continued  by  the  step3. 

Step  6:  Termination 
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The  algorithm  is  terminated  after  a  maximum  generation  number.  The  best  produced 
solution  that  has  been  recorded  in  the  algorithm  is  reported  as  the  best  solution  to  BLPP 
by  proposed  GA  algorithm. 
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Hybrid  algorithm  (HA) 

Penalty  functions  transform  a  constrained  problem  into  a  single  unconstrained 
problem  or  into  a  sequence  of  unconstrained  problems.  The  constraints  are  appended 
into  the  objective  function  via  a  penalty  parameter  in  a  way  that  penalizes  any  violation 
of  the  constraints.  In  general,  a  suitable  function  must  incur  a  positive  penalty  for 
infeasible  points  and  no  penalty  for  feasible  points.  Also,  the  penalty  function  method  is 
a  common  approach  to  solve  the  bi-level  programming  problems.  In  this  kind  of 
approach,  the  lower  level  problem  is  appended  to  the  upper  level  objective  function  with 
a  penalty.  We  use  a  penalty  function  to  convert  problem  (15)  to  an  unconstraint 
problem. 

Consider  problem  (15);  we  append  all  constraints  to  the  first  level  objective 
function  with  a  penalty  for  each  constraint.  Then,  we  obtain  the  following  penalized 
problem. 

minF(t)  +  ax(pC+  c2)2  +  a2(\iB  +  b3)2  +  a3(G'(t))2  +  a4(//'(t))2 

-n)2  (17) 
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Now  we  solve  problem  (15)  using  our  line  search  method.  The  line  search  method  is 
proposed  as  follows: 

Given  a  vector  x,  a  suitable  direction  d  is  first  determined,  and  then  /  is  minimized 
from  x  in  the  direction  d.  Our  method  searches  along  the  directions  (  dlld2,...,dn-1) 
where  dj,j  =  1,2,  ...,n  —  1  is  a  vector  of  zeros  except  at  the  y'th  position  which  is  1  and 

dn  =  (vh'vh,,,,,,vh)" 

Clearly,  all  directions  have  a  norm  equal  to  1  and  they  are  linearly  independent 
search  directions.  In  fact,  the  proposed  line  search  method  uses  the  following  directions 
as  the  search  directions: 

dt  =  (1,0  0),d2  =  (0,1  0)  dn_t  = 

(0  1,0), dn  = 

(t=,7=  -f)  (18) 

Therefore,  along  the  search  direction  dj,j  =  1,2,  ...,n  —  1  ,  the  variable  Xj  is  changed 
while  all  other  variables  are  kept  fixed.  We  summarize  below  the  proposed  line  search 
method  for  minimizing  a  function  of  several  variables.  Then,  we  show  that,  if  the 
function  is  differentiable  then  the  proposed  method  converges  to  a  stationary  point. 


Step  1:  Initial  step 
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Choose  a  scalar  £  >  0  to  be  used  for  terminating  the  algorithm,  and  let 
d±l  d2l ...  i  dn_1  be  the  coordinate  directions  and  dn  be  a  vector  of  —  .  Choose  an  initial 
point  x1  let  x1  =  yt.  k  =  j  =  1,  and  go  to  the  next  step. 

Step  2:  Main  step 

Let  [ij  be  an  optimal  solution  to  the  problem  to  minimize  (y;-  +  \idj)  ,  and  let 
yj+i  =  yj  +  Vjdj 

If  j  <  n  replace  j  by  j  +  1,  and  repeat  stepl.  Otherwise,  if  j  =  n,  go  to  the  next 
step. 

Step  3:  Termination 

Let  xk+1  =  yn+1  if  \\xk+1  —  xk\\  <  a  then  stop,  otherwise,  let  y1  =  xk+1  and 
7  =  1,  replace  k  by  /c  +  1,  and  repeat  step  2. 

We  now  propose  a  theorem  which  establishes  the  convergence  of  algorithms  for 
solving  a  problem  of  the  form:  minimize  f(x)  subject  to  x  E  Rn.  We  show  that  an 
algorithm  that  generates  n  linearly  independent  search  directions,  and  obtains  a  new 
point  by  sequentially  minimizing  f  along  these  directions,  converges  to  a  stationary 
point.  The  theorem  also  establishes  the  convergence  of  algorithms  using  linearly 
independent  and  orthogonal  search  directions. 

We  now  show  that  two  problems  (15)  and  (17)  have  the  same  optimal  solution 
according  to  the  following  theorem. 

Theorem  5.1: 

Consider  the  following  problem: 
min/U) 

X 

s.tgt  (x)  <  0,  i=l,2,...,m,  (19) 
hj  (x)  =  0,  j=l,2,...,l, 

where  f,Q\,  ■■■,gm>  hlr...,hi  are  continuous  functions  on  Rn  and  X  is  a 
nonempty  set  in  Rn.  Suppose  that  the  problem 

has  a  feasible  solution,  and  a  is  a  continuous  function  as  follows: 

a(x)  =J3L10[gl(x)]  + 
ZU0IM*)] 

where 

0(y)  =  0  if  y  <  0,  0(y)  >  (21) 
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0  if  y  >  0. 

0(y)  =  0  if  y  =  0,  0(y)  > 
0  if  y  *  0. 


(22) 


Then, 


\nf{f(x)\g(x)  <  0,  h(x)  =  0,x 
ex] 

=  inf{/(x) 

+  \ia[x)\x  G  X} 


(23) 


Where  |i  is  a  large  positive  constant  ( |i  ->  oo) . 
Proof: 

This  theorem  has  been  proven  by  (Nocedal,  J,  &  S.J.  Wright.  (2005)). 
Computational  results 

To  illustrate  both  algorithms,  we  consider  the  following  examples. 
Example  1  (Zhang  ,  G,  J.  Lu  ,  J.  Montero  ,  &  Y.  Zeng  ,  Model.  (2010)): 
Consider  the  following  linear  tri- level  programming  problem: 
minx  -  4y  +  2z 

X 

s.t 

-x-y  <  -3, 
-3x  +  2y-z  >  -10, 

min  x  +  y  —  z 

y 

s.t 

-2  x  +  y  -  2z  <  -1, 
2x  +  y  +  4z  <  14, 

minx  -  2y-  2z 

y 

s.t 
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2x-y-z<  2, 
x,y,z>  0. 

Using  KKT  conditions,  the  following  problem  is  obtained: 
minx  -  4y  +  2z 


-x-y  <  -3, 

3x  -  2y  +  z  <  10, 
-2  x  +  y  -  2z  <  -1, 

2x  +  y  +  4z  <  14, 
(51(-2x  +  y-2z+  1)  =  0, 

p2(  2x+y  +  4z-14)  =  0, 

Pi  +  P2  =  1, 
2x-y-z  <  2, 
n(  2x-y-z-2)  =0, 
H(-1)  =-2, 
x,y,z,  Pi,  p2  ,[i>  0. 
By  the  proposed  function,  the  above  problem  becomes: 
minx  -  4y  +  2z 
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X 


X 


s.t 


-x-y  <  -3 


3x  -  2y  +  z  <  10, 


2pi-(-2x  +  y-2z  +  1) 
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2(32-(2x  +  y  +  4z-14) 
-J  p22  +  (2x  +  y  +  4z  -  14)2  +  S  =  0, 

2ji-(2x-y-z-2) 
-Vli2  +  (2x-y-z-2)2  +  £  =  0, 

Pi  +  P2  =  1, 
\i(-l)=-2, 
x,y,z,  plf  p2  ,|i>  0. 

Optimal  solution  presented  according  to  Table  1.  Behavior  of  the  variables  in 
Example  1  has  been  show  in  figure  1 . 


0   I   2  3  4  5  6  7  8  9  10  II  12  13  14  15  16  17  18  I* 
I  ntcrat  tonM  thousand ) 


Figure  1-  Behavior  of  the  variables  in  Example  1 


Table  1-  Comparison  of  optimal  solutions  by  genetic  algorithm  -  Example  1. 


Optimal  Solution 

Best  solution  by  our  method 

Best  solution  according  to  reference 

(x*,y*,z*) 

(4,6,0) 

(4,6,0) 

Fi(x,y,z) 

-20 

-20 

F2(x,y,z) 

10 

10 

F3(x,y,z) 

-8 

-8 

Example  2  (Zhang  ,  G,  J.  Lu  ,  J.  Montero  ,  &  Y.  Zeng  ,  Model.  (2010).): 
Consider  the  following  linear  tri-level  programming  problem. 
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minx  +  4y  +  2z 

x 

s.t 

x-  3y  +  9z  <  30, 
-3x  +  5y-z  <  -100, 

min  —  x  +  ly  —  z 

y 

s.t 

3x  +  5y-z  <  160, 

min  lx  +  y  +  21z 

y 
s.t 

3x-4y-2z  <  212, 
x,y,z  >  0. 


Optimal  solution  for  this  example  is  presented  according  to  Table  2.  Behavior  of  the 
variables  has  been  show  in  figure  2. 


Table  2-  Comparison  of  optimal  solutions  by  Taylor  algorithm  -  Example  2. 


Optimal  Solution 

Best  solution  by  our  method 

Best  solution  according  to  reference 

(x*,y*,z*) 

(10,28.33,11.66) 

(10,28.33,11.66) 

Fi(x,y,z) 

146.66 

146.66 

F2(x,y,z) 

176.6 

176.6 

F3(x,y,z) 

343.3 

343.3 

0   I    2  3  4  5  6  7  8  9  10  II  12  13  14  15  16  17  18  I9< 
IntcrationM  thousand ) 
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Figure  2  -  Behavior  of  the  variables  in  Example  2 
Example  1  (solving  by  hybrid  algorithm): 

Consider  the  following  linear  tri- level  programming  problem: 
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minx  -  4y  +  2z 

x 

s.t 

-x-y  <  -3, 
-3x  +  2y-z  >  -10, 

min  x  +  y  —  z 

y 

s.t 

-2  x  +  y  -  2z  <  -1, 
2x  +  y  +  4z  <  14, 

minx  -  2y-  2z 

y 

s.t 

2x-y-z<  2, 
x,y,z>  0. 

Using  hybrid  algorithm  the  problem  is  solved.  Optimal  solution  for  this  example  by 
hybrid  algorithm  is  presented  according  to  Table  3. 


Table  3-  Comparison  of  optimal  solutions  by  hybrid  algorithm  -  Example  1. 


Optimal 
Solution 

Best  solution  by  hybrid 
algorithm 

Best  solution  according  to 
reference 

(x*,y*,z*) 

(4.3,6.2,0.1) 

(4,6,0) 

Fi(x,y,z) 

-20.3 

-20 

F2(x,y,z) 

10.4 

10 

F3(x,y,z) 

-8.3 

-8 

Example  2  is  solved  by  hybrid  algorithm  and  computational  results  are  proposed  in 
Table  4. 


Table  4-  Comparison  of  optimal  solutions  by  hybrid  algorithm  -  Example  2. 


Optimal 
Solution 

Best  solution  by  hybrid 
algorithm 

Best  solution  according  to 
reference 

(x*,y*,z*) 

(10.1,28.4,11.6) 

(10,28.33,11.66) 

Fi(x,y,z) 

147.16 

146.66 

F2(x,y,z) 

176.93 

176.6 

F3(x,y,z) 

345.33 

343.3 
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